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Abstract —An important scenario for smart grids which encom¬ 
pass distributed electrical networks is given hy the simultaneous 
presence of aggregators and Individual consumers. In this work, 
an aggregator is seen as an entity (a coalition) which is ahle to 
manage jointly the energy demand of a large group of consumers 
or users. More precisely, the demand consists in charging an 
electrical vehicle (EV) battery. The way the EVs user charge 
their batteries matters since it strongly impacts the network, 
especially the distribution network costs (e.g., in terms of Joule 
losses or transformer ageing). Since the charging policy is chosen 
by the users or the aggregators, the charging problem is naturally 
distributed. It turns out that one of the tools suited to tackle this 
heterogenous scenario has been introduced only recently namely, 
through the notion of composite games. This paper exploits for 
the first time in the literature of smart grids the notion of 
composite game and equilibrium. By assuming a rectangular 
charging profile for an EV, a composite equilibrium analysis 
is conducted, followed by a detailed analysis of a case study 
which assumes three possible charging periods or time-slots. 
Both the provided analytical and numerical results allow one to 
better understand the relationship between the size (which is a 
measure) of the coalition and the network sum-cost. In particular, 
a social dilemma, a situation where everybody prefers unilaterally 
defecting to cooperating, while the consequence is the worst for 
all, is exhibited. 

Index Terms —EV charging - Electrical Distribution Networks 
- Composite game - Composite Equilibrium. 


I. Introduction 

EV charging can lead to significant impacts on the exist¬ 
ing and future energy networks Hi. Considering different 
physical metrics, the smart grid literature pursued the goal 
to mitigate these impacts optimizing EV charging schedules 
using Demand Side Management |3|, proposing charging 
algorithms fllit] or pricing policies 0I3]. 

The EV charging problem can be seen as a distributed 
problem. Indeed, it is reasonable to assume that EV’s owners 
can decide when they plug their vehicles and how they charge 
their batteries. As a consequence, game theoretical tools have 
been proposed to tackle the charging problem (see e.g., ||p 
for a recent survey). Very relevant contributions include 
[H . On the contrary, it may also be assumed that the charging 
prohles of the EVs are decided by a coordinator, often called 
aggregator |@, |T2l, who is much more informed about the 
real constraints of the electrical network. In this case, the 
decision is centralized and optimization tools are used to 
hnd the optimal policy. The present work deals with the 
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situation in between, when a fraction of the EVs is supposed to 
independently decide their charging policies, while the rest is 
governed by an aggregator. This framework has been recently 
introduced in the game theoretic literature El with the notion 
of composite equilibrium and, to the best of our knowledge, 
our work is the hrst to propose an application of this concept 
to the EV charging problem, or more generally to a smart grid 
issue. 

The contributions of this paper include 

• the formulation of the EV charging problem as a com¬ 
posite game, 

■ the characterization and proof of existence of its equilib¬ 
rium, 

■ the description of its main properties in the particular case 
of three time-slots, 

• the numerical analysis of these properties in the case of 
distribution network costs. 

The paper is structured as follows. Sec. [H] provides the 
model of composite games in the context of EV charging. 
Sec.lm] dehnes and characterizes the composite equilibrium. 
Sec. |iy] treats a particular case, and conducts an equilibrium 
analysis. A thorough numerical analysis is then provided in 
Sec. [V] and the paper is concluded by Sec. |VT] 

Notations. Bold symbols stand for vectors. Eor all d G N*, 
Ad = {z = {zi)ti e = 1}; for all 

D>0,Ad^ = {z = (z,)ti e > 0, Eti = D}. 

Eor all m,n G N such that m < n, |m, n] = {m, m -|- 

l,n}. 

Eor X = {xi,X 2 ,-,Xd),x' = {x[,x' 2 ,...,x'^) G R'^, 
(a;, x') = Xix[ denotes the inner product of x and x'. 


II. Composite EV charging game 


A. EV charging game 

There are T time-slots, labeled by t G T = {1,2,...,T}. 
We consider a set of EVs which have to choose C consecutive 
time-slots, C < T, to charge. Each EV is considered as a 
player, i.e. aims to minimize his charging cost taking into 
account the impact of the other EVs’ charging decisions using 
the framework of Game Theory El- The assumption of 
choosing consecutive time-slots is mathematically restrictiv^H 
and thus provides a less general mathematical structure than 
with freely varying charging vectors lll5n . It is nonetheless 


'indeed, the charging vector is only defined by the time to start charging 
while a more general case would be to consider charging vectors in the T — 1- 
dimensional simplex. 
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very important to mitigate impact of the charging policy on the 
battery lifetime because highly time varying charging currents 
can increase battery temperature much more and lead to a 
shorter lifetime [1^. 


B. Composite game 

In this paper, we consider EVs as nonatomic players who 
have weight zero and who are called individuals. Nonatomic 
means that an EV alone cannot have an impact on the cost 
perceived by other players. This holds in particular when there 
is a large number of EVs. A group of individuals of positive 
total weight form a coalition if the behaviour of its members is 
coordinated by an aggregator |@]. A charging game with both 
nonatomic players and coalitions is called a composite game 
1 131] and its equilibria are called composite ones accordingly. 
This corresponds to the practical situation where some of EVs 
decide their charging policies independently, while the others 
are coordinated by one or several aggregators. Without loss of 
generality, the total weight of all the EVs is assumed to be 1. 


C. Charging flows deflnition 

We suppose that there are K coalitions. Eor any coalition k 
of size > 0 (1 < fc < K), let denote the weight of the 
EVs sent by it to start charging at time t G |1, Thus 

the vector g characterizes 

the strategy, or charging flow, of coalition k. 

Eor t G |1,T], let denote the quantity of EVs from 
coalition k charging at time t, and define It is 

called the charging load induced by its strategy x^. Indeed, 

t 

y^= Y. Vl<f<r. (1) 

s—max(i—C+1,1) 

Let be the set of charging loads of coalition k induced 
by its strategies. It is not difficult to verify that is a convex 
and compact subset of K^. 

Eor the individuals of total weight > 0 (M° = 1 — 
'^k=i M^), let Xf be the weight of the individuals starting 
charging at time f G |1, T—C+l]. Define a;° = G 

F° = which can be viewed as the strategy profile 

of the individuals. 

Let be the charging load induced by x^ and F° the set 
of charging loads induced by the strategies of the individuals. 

Einally, let x = (x^){^q G F = F° x F^ x ■ ■ ■ x F^ denote 
the strategy profile of all the players and y — (y*)^Q be the 
system charging load. Denote F = F^ x F^ x ■ ■ ■ x F^ the 
set of feasible system charging loads. 

The total weight of EVs charging at time t is denoted by 


zt := ^ y'l . 

Define the aggregate charging load as 2 = 


D. Cost deflnition 

Let us now introduce the (per unit) charging cost function at 
each time-slot, /. If there are EVs of total weight zt charging 
at time t, then the charging cost for each of them is f(Lt+Pzt) 
during that time-slot, where 

m L = is the non-EV load, assumed to be known; 

> P the total EV charging power in the district, i.e. the 
number of EVs in the district multiplied by the charging 
rate of an EV assumed constant between EVs here for 
simplicitjU 

• and / is a real-valued function defined on [0, W] for W 
sufficiently large, i.e. bigger than the potential maximal 
load in the district. 

This expresses the fact that EV charging cost depends on 
the impact measured in the elctrical network, which is one of 
the main ideas of smart grids. Notice that / is common for 
all the EVs. 

Assumption 1. The charging cost function f is of class C^, 
convex, strictly increasing and nonnegative on [0,1V]. 

Assumption [T] always holds in this paper. 

Eor an individual EV, the charging strategy consists in 
charging from time-slot t to time-slot f-l-C'—1 (tG |1,T — 
C + 1]), and its cost function is 

t-l-C-l 

Ut{x) = Y, f{LsFPzs)yxGF,\/\<t<T-C+l, 

S — t 

(3) 

where the dependency between x and z is implicit in the 
notations and comes from O and (l2]). The average cost to 
coalition k can be written as a function of x 

.. T-C+l 

n''(a:) = ^ Y x’lut{x) , (4) 


or as a function of y 

= + (5) 

t=i 


The average cost to the individuals can be similarly defined 
as a function of flow x, denoted by 11°, or as a function of 
load y, denoted by 11°. 

Einally, the social cost is function of y 

T 

n(y) = '^^t f{Lt F Pzt ), (6) 

i=l 

where, again, the dependancy between z and y is implicit in 
the notations. 

Let this (composite EV) charging game be denoted by 

g{T,C,f, 

^Typically 3kW in the residential case. 


( 2 ) 
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E. Application to distribution network costs 

In the context of residential distribution networks (the 
system which delivers power from the generation points to the 
end users, see HI] for an illustration), two particular classes of 
physical cost functions / will be considered: 

• Joule losses, which is a quadratic one: f{Lt + Pzt) = 

{Lt + Pztf il; 

• equipment ageing (transformers for example), which can 
be approximated by an exponential function (when the 
transformer power is close to its nominal level) ||2]: 
f{Lt + Pzt) = exp[/3(Lt + Pzt)], with ^ > 0. 

Note that the standard "mathematical" linear case will also 
be studied, which corresponds to a standard approximation 
of practical applications. Observe that Assumption [T] holds in 
these three cases and also when considering a weighted sum 
of these objectives. 

III. Definition and characterization of composite 

EQUILIBRIUM 

We are now interested in defining and characterizing a 
configuration of equilibrium at which neither the individuals 
nor the coalitions have incentive to deviate from their current 
strategy. 

A. Composite equilibrium conditions 

At equilibrium, if strategy t is used by individuals, i.e. 4 > 
0, then 

ut{x)<Us{x), Vse{l,2,...,r-C+1} , (7) 

according to the standard Wardrop equilibrium conditions IB. 
Notice that in this case the cost of all the individuals is 
common and equal to the average cost 11°. 

At equilibrium, a coalition k minimizes the average cost of 
its memberHl given the strategies of the other coalitions and 
individuals: 

n'^{x'^,x-'^) = min (8) 

where = {x'^)o<i<K,i^k denotes the strategies of other 
players than coalition k. 

Definition III.l. In a composite charging game 

(y(T, C,/, a configuration x G F is a composite 

equilibrium (CE) if conditions (|7]l and (O are satisfied. 

Composite equilibria can also be characterized via varia¬ 
tional inequalities. Denote the gradient of coalition k’s cost 
w.r.t. its strategy (or flow) by 

^7'=(a;^:= V^.^'=(a;^af'^). (9) 

Define also U^{x) = n°(a;) and let U = (U'^)fLo- 

At the minimum, the first order (necessary) condition of 
the minimization problem (|8]l is 

{U'^{x'^,x-'^),4-x4 >0. (10) 

^This is obviously equivalent to minimizing the total cost of its members. 


Proposition III.2. If for all coalition k, n^(a:^,a;“*) is 
convex with respect to x^ on F^ for all x~^ C F~^, then 
X* G F is a composite equilibrium if and only if 

{U°{x*°, x*-°),x° - x*°) > 0, Va;° e F°, 

{U'^{x*’^,x*-4,x’^ -x*4 >0, Va;'^ e F^Vfc = 

which is equivalent to 


{U{x*),x-x*)>Q, yxeF. 


( 11 ) 


Proof: The proof is similar to the one of Prop. 1 in 1113 1. 


It can be shown that the necessary and sufficient condition 
([n]l remains the same if the cost function / undergoes an 
affine transformation / i—!■ af + b with a > 0, 6 G M. In 
turn, X* is a composite equilibrium of G{T,C, f, 
if and only if it is a composite equilibrium of G{T,C,f + 
b, {M^)f=o) (or g{T, C, af, (M*)^o) for a > 0). This is why 
the simulations at the end of this paper are restricted to the 
case f{Lt + Pzt) = {Lt + Pzt)^ in the quadratic case and 
f{Lt + Pzt) = Lt + Pzt in the linear case. 

With formulation (fTTI) . the existence of an equilibrium in 
the charging game Q{T, C, f, is easily obtained. 

Theorem III.3. If for all coalition k, Il^{x^,x is convex 
with respect to x^ on F^ for all x~^ G F~^, then the charging 
game Q{T, C, f, has a composite equilibrium. 


Proof: Because of the continuity of /, U is continuous 
on the compact and convex set F. The variational inequality 
(fTTI) thus has a solution lIlSll . Given Prop. lIII.Tl this (eventually 
these) solution(s) is (are) a composite equilibrium(s). ■ 


We also have an important property concerning the com¬ 
parison between the cost of individuals, the average cost in a 
coalition and the social cost. Indeed, by the definition of CE, 
individuals choose the least expensive alternative(s) at the CE, 
therefore one obtains the following general result immediately. 

Proposition III.4. Af a composite equilibrium, 

n°(M) < n(M) < n'=(A0, vmg (o, i], Vfc, i<k<K. 

( 12 ) 


IV. Particular case of three time-slots 

In this section, the properties of composite equilibrium are 
studied for a charging game Q{T, C, f, {M'')f^f) with T = 3 
time-slots, a charging duration C = 2, a unique coalition of 
size M G (0,1] and a group of individuals of total weight 
1 — M. This corresponds to a situation where there are a peak, 
an off-peak and a standard time-slot. This also suits the case 
of charging places where EVs do not stay a long time, e.g. a 
parking. Indeed, because the charging rate will not vary with 
a small time step, this leads to situations where the number 
of time periods considered is very small. Einally, this is a first 
step to determine some intuitive theoretical results that could 
be then observed by simulations of cases with a bigger number 
of time-slots. 
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A. Notations of this particular case 

An EV has two alternatives: 

• alternative 1: charging at t = 1 and t = 2; 

• alternative 2: charging at t = 2 and t = 3. 

For the individuals, these are just their strategies. In the 
coalition, the aggregator assigns an alternative to each EV. 

Time indexes are omitted to simplify the notations. Let 
(resp. M — x^) denote the weight of EV to which the 
aggregator assigns alternative 1 (resp. alternative 2), and x^ 
(resp. 1 — M — x^) the weight of the individuals choosing 
alternative 1 (resp. alternative 2). Therefore, x^ € [0,M], 
x^ € [0,1 —M], and they respectively characterize the strategy 
of the coalition and the choices of the individuals. To simplify 
the notations, we set here P = 1 without changing the 
essential nature of the results provided her^l Since all the 
EVs are charging at time-slot t = 2, the per-unit cost for this 
time-slot, /(I -f L 2 ), is common to all the EVs. Thus, we 
simply need to study the following costs 

rno = nO-/(i + L2) 
i ffi = ni -/(1 + L 2 ) . (13) 

[n = n-/(i + L 2 ) 

Considering the choice made by the coalition, 11^ is a 
function of {x^,x^), defined on [0,1]^: 

fri/ 0 i\ f {Li + x^) + {M — x^)f {L 3 + 1 — — x^) 

n (x ,x ) — -. 

For example, in the Joule losses case, f{L) = L^, 


. For M G (, 1] (possible only if 

-/'(l+ia)- < 


{ 0<x*^ <M : 

f{L,+x*^)+x*^f{Li+x*^) 

= /(I + L3 - x*^) + (M - x*^)fil + L3 - 
x*° = 0. 

( 16 ) 

rn = x*^f{Li + x*^) + (1 - x*^)f{l + L3- x*^) 

= f{l + L3-X*^) 

[x*^fiLi + x*^) + (M - x*^)f{l + L3 - 

(17) 


(18) 
(19) 

> For M > 1 -f L 3 — Li(> 0) 


b) Case 2: L 3 < Li < L 3 -f 1.- 
• For M < 1 -f L 3 — Li(< 1) 

*1 ^ *0 1 + T 3 — Li — M 

X = —, X = --- 

2 ’ 2 

n = ffo = ffi =/(i±i|±i:i) 


I+L 3 —Lj ^ — ' 

f{L,+x*^)+x*^f{L,+x*^) 

= /(I + L3 - x*^) + (M - x*i)/'(l + L3 - 
x*° = 0 

( 20 ) 

n = x*^fiLi + x*^) + (1 - x*^)fil + L3- x*^) 
no = /(i + L 3 -x*i) 

n' = ig [x*^f(.Li + x*^) + (M - x*^)f{l + L3- x*^ 

( 21 ) 


x^(Li + x^ + x'^f + (M — x^){L^ + 1 — x^ — x^f 


B. Configuration of composite equilibrium 

Without loss of generality, suppose that Li > L3. This 
means that the cost of the first time-slot (resp. alternative 1 ) 
is higher than that of the third time-slot (resp. alternative 2 ) 
without EV charging. 

The explicit computation of the CE x* using the conditions 
(l7]i and (| 8 ll is omitted. We summarize the results here. Observe 
that the individuals’ common cost, 11 °, the coalition’s average 
cost, n^, and the social cost If are the key variables for 


analyzing the efficiency of the CE. 


a) Case 1: Li > L 3 + 1: 


. For M G (0, (or M G 

— ru+Lf, — ^ 

( 0 , 1 ] if 

x*'^ = 0 , x*° = 0 

(14) 

n = no = ni = /(i + L3) 

(15) 


‘‘This can be done without loss of generality because this is equivalent to 
scaling L. 


C. Properties of composite equilibrium 

Using the configuration of the CE obtained previously, its 
main properties, namely existence, uniqueness, and variation 
with the size of the coalition, are now investigated. 

Proposition IV.l. For all M G (0,1], there exists a unique 
composite equilibrium (a:*°,a:*^). 

Proof: The existence results from Thm. IIII.3I given that 
Assumption[T]holds. The uniqueness directly follows from the 
summary of the results given just before. ■ 

Observe also that the individuals’ weight on the first al¬ 
ternative at CE is independent of the charging cost function 
verifying Assumption [T] 

Since the equilibrium (a:*°, is unique for each coalition 
size M G (0,1], one can now consider the following quantities 
as functions of M and omit the superscript the quantity of 
EV charging from f = 1 in the coalition, x^, the quantity 
of individuals taking strategy 1 , a;°, the individuals’ common 
cost, n°, the coalition’s average cost 11^, and the social cost, 

n. 

Additional properties of the CE configuration 
{x^(M), x^ {M)) can be deduced easily from the results in 
Section IIV-BI To this end, an additional hypothesis on the 
charging cost function will be needed. 
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Assumption 2. Charging cost function f is of class on 

[G,W]. 


Proposition IV.2. Under Assumption \2\ function is contin¬ 
uous and increasing in M on (0,1]. More precisely. 


1 ) 

2 ) 


3) 


if Li > ^3 + 1 and > 1, then is 

constant on (0,1]; 

i/ Li > L3 + 1 and < 1, then x^ is con¬ 
stant on (0, ] and it is strictly increasing 

in M on 1]; 

If L 3 < Li < L 3 -\- 1, then x^ is strictly increasing in 
M on (0,1]. 


Proof: Both the continuity of x^ on (0,1] and the mono¬ 
tonicity are obtained by using the implicit function theorem 
on the equations characterizing x^. ■ 


The proofs of the following results of this paper, which are 
also based on the application of the implicit function theorem, 
are omitted. Considering the weight of individuals using 
strategy 1, a similar result, but with the opposite monotonicity, 
is obtained. 


Proposition IV.3. Function x^ is continuous and decreasing 
in M on (0,1]. More precisely, 

1 ) ifLi > 2^3 + 1 , then x^ is constant (x^ = Oj on ( 0 , 1 ]; 

2) if L3 < Li < L3 + 1, then x^ is strictly (linearly) 
decreasing in M on (0,1 -f L 3 — Li) and it is constant 
(x° = 0) on [1 + L3 — Li, 1]. 

An intuitive interpretation of Pror) IIV.2l and Pror) IIV.3l is as 
follows. The bigger the coalition, the more EV it puts on the 
more expensive charging alternative, and the less individuals 
who choose the more expensive alternative. This highlights 
that bigger coalitions integrate more externalities. When the 
coalition is of size one, this leads to the social optimum. 

The following proposition now characterizes the convexity 
of the EV put on strategy f = 1 at equilibrium, x^. 

Proposition IV.4. If f is linear x x, quadratic x 1 —>■ x"^, or 
exponential x 1 —>■ (/3 > 0), then function x^ is concave in 

M on (0,1]. 

This proposition expresses a phenomenon of saturation. 
Although the coalition puts more EVs on the more expensive 
alternative when its size increases, the additional weight on 
this alternative decreases with respect to its size. Note that 
some properties for the function x^ such as its linearity or strict 
concavity are available for some choices of the parameters Li 
and L 3 as for Prop. IIV.2I 


D. Cost at the composite equilibrium 

Eirst of all, according to (fl4] |. (fTST l. (fTsT i and (l20l l. the 
continuity of and x^ leads to that of 11°, 11^ and If on 
their domains of definition. In particular, (fThl l and (fTSl l show 
that n° can be extended to M = 1 in a continuous way. Thus, 
one has the following corollary of Prop. IIV.2I 


Corollary IV.5. Under Assumption |2] the individual’s cost 
n°, the average cost of the coalition 11^, and the social cost 
If at the CE are continuous in M on (0,1]. 

After this technical property, two issues arise to better 
understand the influence of the coalition on the costs: 

1 ) comparison between the cost of individuals, the average 
cost in the coalition and the social cost; 

2 ) analysis of the monotonicity of these costs with respect 
to the size of the coalition M. 

Concerning the first issue, the answer is given in the general 
case by Prop. IIII.4I the cost of individuals is smaller than the 
social cost which is itself smaller than the average cost in the 
coalition. Let us now focus on the impact of the size of the 
coalition on 11°, If, and 11^. This is of primary interest for a 
social planner who tries to analyze the cost of the different 
entities under its supervision and to decide if it is worthwhile 
to encourage the formation of coalitions. 

Proposition IV.6. Under Assumption^ the individual’s cost 
n°, the average cost of the coalition 11^, and the social cost 
If at the CE are decreasing in the size of the coalition M. 

The previous proposition shows that the bigger the coalition 
is, the better it is for everyone. However, considering Prop. 
nil. 41 this leads to a "social dilemma", a situation in which 
collective interests are at odds with private interests. Indeed, 
the social optimum is attained when the coalition is global, i.e. 
M = 1; meanwhile, according to Prop. IIII.41 each EV prefers 
to act individually, leading to M — 0. This phenomenon is 
similar to the one studied in 0 . Designing incentives to 
encourage EV to join the coalition could constitute a relevant 
extension of this work. 

V. Simulation results 

A. Quantifying the results of the particular case T = Z, C = 2 

We first investigate the particular case T = 3, C = 2. The 
non-EV load is supposed of the form L = (Li,l,l) with 
Li > 1 representing the load at peak time of other electrical 
consumptions, P = 1, and /3 = 1 when the exponential 
charging cost function / is considered. In turn, this provides 
a thorough application of the theoretical framework presented 
in the previous part. The CE configuration is thus directly 
given, by (fT4li for example, or calculated by solving implicit 
equations, (fTSl l for example. The variation of the configuration 
of the CE and that of the equilibrium costs associated will 
be analyzed and quantified according to the charging cost 
function / and the size of the coalition M. 

Fig.fn and |2] present the weight x^ put by the coalition on 
alternative 1 for the three standard charging cost functions: 
linear, quadratic, and exponential. As theoretically claimed, 
when Li > P 3 +1 (cf. Eig. m, x^ is zero for small values of 
M, and it becomes positive from different thresholds of M for 
different metrics /. When Pi < P 3 + 1 (cf. Eig. |2]l, x^ is the 
same for all the metrics / up to a common threshold M = 1 + 
L 3 — L 1 , after which x^ is different for different metrics. Also, 
one observes that x^ is greater when Pi is relatively lower or, 
equivalently, when time-slot 1 is relatively less expensive. Take 
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the linear cost metric as example. Fixing L 3 = 1, if Li = 2.3 
(Fig. [TJ, remains 0 till M = 0.3 then it increases linearly 
to 0.18 when M = 1; while if Li = 1.5 (Fig.|2]), increases 
in a piecewise linear manner from 0 to 0.37 while M varies 
from 0 to 1 . 



■| 0.18 

8 0.16 

W 

(T3 

2 “■'I'* 
1 0.12 

(D 

CM 

J. 0.08 

o 0.06 
D) 

C 

‘o) 0.04 
(5 

“ 0.02 

.c 
‘o) 


Coalition size M 


—B— Indiv. iin./quad./exp. 
Coai. linear 
O Coai. quadratic 
Coai. exponentiai 


This highlights that the configuration with a coalition of size 
one is very efficient but also very unstable in the sense that 
each individual EV has a great interest to quit the coalition. 



0.98 

0.96 

0.94 

0.92 

0.9 

0.88 


□ Individual cost, exp. case 
O Average cost to the coalition, exp. case 
—^— Social cost, exp. case 

- B - Individual cost, quad, case 

- © - Average cost to the coalition, quad, case 

- Social cost, quad, case 


0.86 


0 


0.2 0.4 0.6 0.8 

Coalition size M 


Fig. 3. Individual, coalitional and social cost at CE for a quadratic or 
exponential charging cost function and Li = 1 . 5 <L 3 + l. 


Fig. 1. Configuration of CE according to the size of the coalition M for 
Li= 2 . 3 >L 3 + 1 : the individuals do not use the most expensive alternative 
t=l- 2 . 



Coalition size M 


Indiv. Iin./quad./exp. 
Coal, linear 
Coal, quadratic 
Coal, exponential 


Fig. 2. Configuration of CE according to the size of the coalition M for 
L 3 < L\ = 1.5 < L 3 + 1. 


Next, the cost of CE is analyzed in the case of an expo¬ 
nential or quadratic charging cost function. Eig. |3]presents the 
different normalized costs, i.e. the costs divided by the social 
cost at M = 0. It shows the ranking between individual, 
coalitional and social costs and their monotonicity. It also 
quantifies the social benefit realized with respect to the size of 
the coalition. In the quadratic case, for example, a small gain 
of approximately 3% is made with a coalition of size M = 1 
in comparison with the case with only individuals (M = 0). 
However, in the situation of a global coalition (M = 1), this 
figure also shows that any EV deviating to schedule alone its 
charging policy will do a significant benefit of 9%. 


B. A first step towards larger dimensions 

As one would expect, determining the CE of a game is rather 
complicated. Even for some given charging cost function / 
and for small instances, it may be impossible to give the 
explicit form of the equilibrium configuration analytically. 
Consequently, it is of interest to see whether there are simple 
and distributed learning schemes that allow players to arrive at 
a reasonably stable solution. One of these schemes is based on 
an exponential learning behavior where players play the game 
repeatedly and learn the best strategies by keeping record of 
their strategies’ performance (see 1191] ). At each step denoted 
by index n, the individuals update their cumulative cost for 
strategy t, as 


yOXn) ^ y 0 ,in-l) y ^ ( 22 ) 

where is the strategy profile 

of all the players at the {n — l)th iteration of the dynamics. 
These cumulative costs reinforce the perceived success of each 
strategy as measured by the average payoff it yields. Hence, 
the players will lean towards the strategy with the smallest 
cumulative cost. The precise way in which this is done is by 
playing according to the exponential law; 


0.(n) _ 

X 4 . - 




0,(n) 




T-C+l 


(23) 


A,if'' 


Similarly, the coalition updates its cumulative cost V^. 
for strategy t replacing by in i 

and its weights according to (l23t with instead of 

When players update their cumulative costs in continuous 
time, we obtain the standard replicator dynamics ilOT. In¬ 
terestingly, this dynamics has been shown to convergqj for 

^Furthermore, if the convergence point is an interior point, it is a composite 
equilibrium. 
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composite games in the case of linear cost functions lEotl . 

First, this dynamics has been tested on the simple cases 
analyzed in Sec. IV-AI and we find the same results as the 
ones obtained with the analytical formula, not only for the 
linear case for which it is theoretically proven but also for the 
quadratic and exponential cases. This is of primary interest for 
practical applications and also leads to the open problem of 
the convergence in the quadratic and exponential cases. 

Then, we propose a first realistic application studying 
the EV charging during the night time in a district with 
T = 7 considering a two hours time step; t = 1 corre¬ 
sponds to 5pm — 7pm, t = 2 to 7pm — 9pm, ..., t = 7 
to 5am — 7am the next day. The sequence of non-EV 
loads is a normalized version of the global consumption 
profile in Erance for the aforementioned period of time; 
the data are available on the RTE website "http;//clients.rte- 
france.com/lang/fr/visiteurs/vie/courbes.jsp". The other param¬ 
eters are set to C = 3 and P — 0.2 which corresponds to the 
case where EVs need to charge until 75% of their battew 
capacitie^ and a penetration rate of approximately 40'%Q. 
Einally, the linear charging cost function f{L) = L, for which 
convergence of the replicator dynamics holds, is considered. 
We first observe the total load during the considered night, as 
the sum of the non-EV load, the individual nonatomic charging 
load and the coalition charging load. It can be observed that 
while individuals charge mainly during the night when the 
non-EV load is small, coalition’s load is more uniformly 
distributed. 



Fig. 4. Total load at a CE for EV night charging (T = 7 > 3) with a linear 
charging cost function f{L) = L: individuals’ load is put on the "valley" of 
the non-EV load, coalition’s load is more uniformly distributed. 



Fig. 5. Configuration of CE for EV night charging (T = 7 > 3) with a linear 
charging cost function f{L) = L according to the size of the coalition M : 
the monotonicity properties theoretically established for T = 3 and C = 2 
still seem to hold. 


properties of the charging weights (respectively costs) at CE 
proven in the case T = 3, C = 2 still seem to hold; a 
next step of this work will be to confirm these observations 
with theoretical arguments. Einally, this again exhibits the 
phenomenon of "social dilemma". 



Fig. 6. Individual, coalitional and social costs at a CE for EV night charging 
(T = 7 > 3) with a linear charging cost function f{L) = L according to the 
size of the coalition M : the monotonicity properties theoretically established 
for T = 3 and C = 2 still seem to hold. 


The two following figures are dedicated to study if the main 
theoretical properties established in the particular case of three 
time-slots are still observed when considering this larger case. 

Fig. 0 (respectively Eig. 01 shows that the monotonicity 

full charging of a battery of 24kWh at 3kW needs Shours. 

^Given that the maximal household electricity consumption is typically of 
6kW and the EV charging rate at home of 3kW, the ratio = 0.4 

approximates the EV peneteation rate in the district under the assumption that 
all houses consumes at their full conteacted power at peak time. 


VI. Conclusion 

In this paper, we introduce the game-theoretical framework 
of composite games as a tool to analyze the situation where 
both autonomous EVs and coalitions of EVs, i.e., groups of 
EVs which are coordinated by a unique aggregator, coexist 
when taking their charging decisions. In this context, the 
existence of a stable configuration, a composite equilibrium, 
is proven to exist. At equilibrium, the cost of individuals, the 
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average cost in the coalition, and the social cost have been 
compared. 

Then, more detailed properties of the composite equilibrium 
are established in the illustrative case of three time-slots as a 
first step to validate some intuitions. In particular, it is shown 
that the charging weights on the time-slot with the largest 
non-EV demand/load increases with the coalition size for the 
coalition, while it decreases for the individuals. This highlights 
the different behaviour of the individuals and the coalition, 
expressing in particular that larger coalitions integrate more 
externalities. Furthermore, all the costs are proven to decrease 
with the size of the coalition supporting the idea of forming 
big coalitions for EV charging but leading also to a standard 
“social dilemma”: The social optimum is obtained for a 
coalition of maximal size but then each EV prefers to act 
individually. A relevant extension of this work would be to 
design incentives to make the configuration with a coalition 
of maximal size stable. 

Finally, simulations both quantify these phenomena in the 
simple case of three time-slots and are also conducted in the 
realistic case of EV night charging with a larger number of 
time-slots. Interestingly, the theoretical results proven in the 
case of three time slots seem to hold in the simulation realized 
in this latter case: this shows that there is still room for 
improving the understanding of the properties of this problem 
in a general setting. The framework of composite games seems 
to be particularly promising for understanding heterogenous 
distributed networks such as smart grids. 
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